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(57) Abstract: The idea according tot he invention is to divide a given area into cells, each of which is being indicated as treated, 
untreated or occupied by an obstacke, and to determine a navigation route, to an untreated cell, that requires the smallest amoung of 
energa according to a predetermined energy cost funciton.. The af^^aratus is then navigated for the current cell to the untreated cell 
according to the navigation route and the indication of that cell is updated as treated. Preferably, the energy cost function depends 
both on the distance from eh current cell to the untreated cell as weU as the total change of direction require for moving theieto, a 
laiger change of direction and a larger distance being given a laiiger cost. Preferably, the task of detennining a navigation route to an 
untreated cell is based on an efficient stnictured search pn)cedure of low computational complexity. 
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ENERGY-EFFICIENT NAVIGATION OF 
AN AUTONOMOUS SURFACE TREATMENT APPARATUS 

TECHNICAL FIELD OF THE INVENTION 

s The imesent invention gei^rally lelaites to autonomous aqoparatoses for sui&ce 
treatment, and especially to the navigation of such ai^paratuses over a predetermined 
field of operation. 

BACKGROUND OF THE INVENTION 

10 

AatoBamoiis surface treatment apparatuses such as autonomous or robotic vacuum 
cleaners are well known in the prior art, for exanq>le as disclosed in the bitemational 
Patent plications WO 97/41451 (US Patent No. 5,935,179) and WO 00/38028, 
respectively. Sodi antonomoos sor&ce treatment 2q;)paratiises generalty have a main 

15 bodjr, being siqi^rted on or by a mmiber of mo^^ or rollers and means 

for surfece treatmrat sudi as rotating brushes in combination witii a vacuum cleaning 
device. Further, a sensiog system, usually in combination witii transmitters, is 
provided for guidance, navigation and obstacle detection. The sensing system generally 
sweq)s around the horizon in analogy, for exanq>le, widi shq^ A microprocessor 

20 tog^r witii appropriate software controls tiie transmitters and motors of the device. 
Normally, die miarpproc^sor also receives irput data fiom die wheels and the srasing 
system for the purpose of position information and localization of wall limitations as 
weU as potraitial obstacles. This input data is then typically used as the basis for 
navigating the autonomous sQq)aiatus so that it, for instance, will be able to perform a 

25 deamng fonction or other sur£ice treatment fonc^on according to some i»«letennined 
strata and at the same time avoid collidixig with diffisrent obstacles and limitations 
such as walls or the like. 
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For example, many robotic vacuum cleaners of today start their cleaning task by 
tracking the walls of the room in question and then condnue to move in a random 
pattem untfl they estimate that the whole room, apart from possible obstacles, has 
been covered. Although this strategy works quite well in practice, it is evident that 
such a vacuum cleaner may go over the same area several times, while other areas 
remain uncleaned even after a long period of operation. 

The issue of providing a more efficient strategy for navigating an autonomous 
sur&ce treatment apparatus over a given area has been addressed in die prior art* 

US Vzt&at 4,674,048 relates to a guidance system for a mobile robot. The system is 
based on a grid-like map in v^ch columns and rows are defined. The system studies 
and stores a travelling range, and guid^ die robot through a travel pattem within die 
specified range by sequential^ moving the robot back and fordi along one of the 
columns and rows of die map in the specified range, while sequentially shifting die 
robot to one of the subsequent columns and rows. Li response to detection of an 
obstruction the robot shifts to one of the next column and die next row by turning die 
robot at a position where die obstruction is sensed. In this way, the robot is allowed 
to travel within the range without leaving any region untravelled and talring notice of 
possible obstmctions which alters its course. 

US Patent 5,440,216 relates to a robot cleaner, which mitially follows the walls of a 
room to memorize flie structure and size of the room and then compares die 
memorized stmcture with previously stored data to select die program most similar to 
the memorized structure. Tte cleaner then performs the cleaning operation according 
to die selected program, moving in parallel lioes in accordance with the room 
structure. 
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The Inteniational Patent Application WO 99/59402 discloses a robot provided with a 
sensor unit and a navigation system. The sensor unit senses tiie proximity to boundary 
markers located along the outer edge of an area to be covered. The navigation system 
navigates the robot in generally straight, parallel lines and turns the robot when the 
5 robot encounters a boundary marker. 

The International Patent Application WO 00/3802S discloses a floor cleaning device 
ananged so tiiat it first completes a traverse around the edge of a room and then moves 
inwards and completes a second tcav^:se of the room, and continues to move inwards 
10 after eadi traverse until the room, apart from areas ocaqned by obstacles, has been- 
cleaned, thus generally defining an inwardly spiral pastsm of movement* 

Altii(»igh the above strategies can be used with qpiite satisfEU^tory results, the efficiency 
tends to decrease significantly in many practical cases when there are several obstacles 
IS of various sizes and forms that constant^ break the nominal path of the autonomous 
apparatus. In partteular, the strategy of moving the autraiomous appaxatos bade and 
forth m geneially straight, parallel lines has turned out to be sensitive to environments 
with elongated obstacles, eqiecially wbsn some of the elongated obstacles are arranged 
p^pendicularly to tiie movement of the apparatus. 

20 

Consequ^itiy, ti^re is still a general need for an efficient strategy for navigating an 
aubmomous sur&ce treatment qyparatns over a given field of operation. 

RELATED ART 

25 

US Patent 5,006,988 relates to an obstacle-avoiding navigation system for guiding an 
autonomous device through a field of operation without collidmg with obstacles. The 
system utilizes a memory for storage of data defiiung an array of grid cells which 
correspond to respective subfields in the field of operation. Each grid cell contains a 
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value that is indicative of the probability that an obstacle is present in the associated 
subfield. The subfields are scanned for determining the presence of an obstacle 
therein and die values in the grid cells are incremented individually in response to each 
scan of the subfields. Furthermore, a region of operation in the vicinity of the vehicle 
is defined, and a plurality of vectorial values are computed in response to the 
location of the grid cells within the defined region of operation with respect to die 
location of the vehicle as well as the vahies in the relevant grid cells. Finally, a 
resultant guide vector diat can be used m guiding the vehicle flirough the field of 
operation so as to avoid collisions is produced based on the vectorial values. 

US Patent 5,684,695 and the Inteniational Patent Application WO 98/00767 concem 
various improvements relating to the so-called occupancy levels in the cells of a 
ceUularly stractured map of the fidd of operation for providing efficient obstacle- 
avoiding navigation. 

The Xhtemational Patent Application WO 00/10062 discloses a m^od and device for 
determining a path around a defined reference position. The padbt is d^ermined by 
iteratively d^ennming an arc-shaped path around die refb:ence position at a defined 
distance therefrom, and verifying the absence of obstacles along the arc-shaped path. 
As long as no obstacles are d^ected, the path is extended. If an obstacle is however 
detected, die distance is increased by a given value and die process is repealed using 
the increased distance. 

SUMMARY OF TBDE INVENMON 

It is a general object of die present invention to provide an energy-efficient strategy for 
navigating an autonomous surface treatment q)paratus over a predetermined field of 
operation. 
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patent claims. 

,..a«enBi«d COS. f^<». subset 

20 leducedbyusingapropcreDMgyc^ 

_^ ^«»i^fi hnft cm the distance fcm. the current 
Preferably, the energy cost fonctioa depends bom cm 
Preferably, tne ^'^^ 
cdl to an untreated cell as wen as me HJiai 

* ^wrion and a larger distance being ^cn a brger cost 
ftereto, a larger change of direction ana a larger u»««vw 

, c™se.,»e^.co»ide»ti»,s,K*on.y«^«.^ 
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sqpparatus is moving over the surface perfomiing for instance a cleaning task, and not 
when the apparatus rotates on the spot. 

Preferably, the task of determining a navigation route to an untreated cell is based on 
5 an efficient structured search procedure of low computational complexity. 
Advantageously, the search procedure involves allocation of costs to a number of 
cells hi the surroundings of &e current cell based on distance as well as required 
change of dhrection for moving to ttie respective cell. In general, the cells are 
checked in cost-order starting from the cell having the lowest cost until a cell that is 
10 indicated as nntreated is found. The route to the found cell is extracted as a lowest- 
cost navigation route to an untreated cell, and die autonomous sur&ce treatment 
apparatus is navigated from the current cell to the untreated cell according to the 
extracted navigation route. Each cost-allocated cell is conveniently assigned a 
direction indicator to enable extraction of the lowest-cost route by means of back 
IS tracing- Once die untreated cell has been treated by the autonomous apparatus, the 
indication of diat ceill is updated as treated. 

Checkmg die cells in cost-order ensures that a lowest-cost route is found, and keeps 
the computational conq)lexity of the search procedure at a low level. Using 
20 procedures of low ccnxpitational complexity is of outmost inq>oitance in order to 
relax the requirranents on memory and processor capadty. 

The mvention offers the followii]^ advantages: 

Energy-ef&cient navigation over a given field of operation; 
25 - Minimized number of rotadons; 

Stractured and ef&cient search for untreated areas; 

Low conqpfotational conq>lexity, leading to relaxed requirraients onmemcny and 
processor capacity. 
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Other advantages offered by the present invention will be appreciated upon reading of 
flie below description of flie embodiments of the invention. 

BRIEF BESCRiraON OF THE DRAWINGS 

5 

The invention, together with further objects and advantages thereof, will be best 
miderstood by reference to the following desciiption tafcen together wiOi the 
accoixq>anying drawings, in which: 

10 Fig. 1 demonstrates a top view of an antraiomous device in form of an embodiment 
showing a vacunnohdeaniiig robot equq9>ed according to the present invention; 

Fig. 2 shows a side view of the autonomous device according to Hg. 1; 

IS Fig. 3 shows a front view of the autonomous device iUustrating the transmitter member 
at the front and two rows of receiving sonsors; 

F9g. 4isahanlwaxeblo(^diagramof thedeviceaccordiiigtoHgs. 1,2 and 3; 

20 Fig. 5 is a schematic drawing of a predetermined field of qp^ration and a 
correspondiiig cell-based map; 

Figs. 6A-D are schematic drawings of a search map at different stages during the 
search for anuncleaned cell accordmg to a basic embodiment of the inventicm; 

25 

Fig. 7 is a schematic flow diagram of a search procedure according to an illustmtive 
embodiment of the uwendon; 
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Fig. 8 is a schematic drawing of a predeteimined field of operation and a 
corresponding cell-based map; 

Figs. 9A-D are schematic drawings of a search map at different stages during the 
search for an uncleaned cell according to a preferred ^nbodiment of die invention; 

Fig. 10 is a sdiematic drawing of a given cleaning area; 

Figs. IIA-P are schematic drawnigs of a cell-based map during navigation of a 
vacuum-deaner over a given deaniiig area, together wifli corresponding search 
m£^; and 

Fig. 12 is a schemiatic drawing showing an example of how die autonomous vacuum 
dealer may navigate to peiform deaning of an entire room. 

DfiTAIUED DESCmmON OF EMBODIMENT OF IHE INl^^^ 

Throughofut die drawings, the same reference characters will be used for 
corcespanding or similar elements. 

In the followii^, die inventioii win be described with refezence 
of an autonomous sar&ce treatment apparatus, namely an autcmamous vacunm- 
deanmg device, ft should however be understood tibat the invention is not limited 
thereto, and tiiat die invention is aqpplicable to various other autonomous ^jparatuses 
for surface treatment, sudi as autonomous devices for swe^mg, brushing and floor 
polishing as well as robotic lawnmowers. 
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General features 

Fig. 1 iltustrates in a three dimensional top view an illustrative embodiment of an 
autonomous vacuum-cleaning device 1, which by itself will move on a floor and 
vacuum-clean a room. In the front portion there is arranged an ultrasonic system. The 
ultrasonic system conoprises a stiip-shaped ultrasonic transmitter 10 having a l^igdi 
covering of the order 180"^ of the front perimeter of the device as ilhisbated m Figs. 2 
and 3. As seen in Fig. 2, die transmitter 10 with strip-shaped elements is mounted 
above a lower first row of microphone units 12. Above the strq)-sluq)ed transmitter 
elements a second row of microphone units 13 is localized. The ultrasound echo sensor 
miQX>phones 12 and 13 together with the transmitter 10 form an ultrasonic sonar 
syst^ fiir the navigation of the device. In the ilhistrative embodimmt the transmitter 
transducer is countersinked in a fixrward directed, movable bmnper unit 16. The 
bun[q)er 16 controls a left and a right bunq^er touch s^isor, either one bdng actuated if 
the bumper makes contact with an obstacle. In Figs. 2 and 3 it will be seen that the 
device has two diametrically positioned wheels 17, 18. The wheels 17, 18 are each 
mdq)endently driven by a separate motor preferably equipped widi a gearbox. The 
driven wheels 17 and 18 will eimble the device to also rotate around its own symmetry 
center or around eitiber wheel 17, 18. On the axis from each motor drivmg the 
respective wheel 17 and 18 a respective quadrature sensor is mounted. Quadrature 
signals from the sensors are connected to a built-in micrqprocessor controlling the 
device. The signals from these sensors, or equivalent devices, will be used for 
obtainiqg a dead count fixr estimating the distance of travel. Qptkmal wheels sappoiL 
the back of the device. The device is generally balaixred with a slighdy larger weight 
on flie rear half of flie device, carrying for instance flie batteries, such fliat it wiD 
always move with aU wheels m contact with the floor. Due to this ba^ 
may easily clinib die edges of floor caipds and the like. 
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Further, the autonomGfus device may advantageously be equipped with Hall effect 
SQEisoTS, preferably one in front of each wheel, for detection of a magnetic fence 
ai^or one or more magnetic strips in connection with the automatic charging station 
used for charging the device. The magnetic fence can be used to restrict the movement 
5 of the device. For example^ the fence can be placed so that tiie device does not fall 
down the stairs. It can also be placed so as to separate rooms wi£hout having to close 
the door. In this way, it is passible clean one room at a time, which has turned out to 
be an effective way of cleamng. 

10 Fig. 4 is a haidware blodc diagram of die device accordmg to Figs. 1, 2 and 3. The 
hardware basically consists of a processor board, whidi is configured to drive the two 
wheel motors, the ultrasonic transmitter and the correq[K>nding microphone based 
receiver system, the fan and brush motors as well as other components of die 
autonomous vacuumrcleaning device. The processor board is essentially built around a 

15 data processor such as the MC68332 from Motorola Inc. 

The wheel motors are separately controlled by pulse-widlh modulated signals of S 
kHz generated by two more channels from the Time Processor Unit in the main 
processor. Jn order to detect how much each wheel has rotated, die quadrature 

20 encoders mounted in connection with the wheel motors generate quadrature signals 
that are connected to Time Processor Unit (TPU) ii^ts of the MC68332. The 
quadrature signals are processed by the processor to provide position information by 
lceq[)ing track of the distance of travel and preferably also die rotation of the 
autonomous device during movement. The processor (running in QDEC mode) gives 

25 such position information with an accuracy of 2642 slots per revolution controls. 

The sonar localization sensing system formed by ti^ transmitter and receiver system is 
utilized by the autonomous yacuum-deaning device for obstacle detection purposes, 
sudi as detection of obstacles in the path of die moving device, pinpointing the exact 
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locatioa of ihe nearest obstacle. The processor controls the transmitter and receives 
inpat data from flie receiver Systran for subsequent evaluation. 

The processor also controls the motor for the rotating brush as well as the motor for 
5 diefen, whetem the fen generates the necessary vacuum for the general finic^ 
vacuum deaner. Air from the fen motor is additionaUy in a knovra manner util^ 
coolmg purposes and ttte air is eriiausted at a gilled outlet at the top of the device. 

The processor is controlled by software stored in a number of different types of digital 
10 memories fiir esranple of type EPROM, RAM or EEPROM, which are aU well known 
to a pereon femiliar to conq^uter techniques. MMcsaSfy the processor has its own 
doddng ^stem CLK also known fix»n the prior art 

The system as iUustiated m Rg. 4 further comprises a number of switches, two 
15 bamga switches and two tilt switches. The two bumper switches L-Bumper, R- 
Bumper axe connected to two TPU mput pins working m discrete I/O mode, and are 
used as a coai^lenient to the sonar system for detectian of coUi^ons wifli obstacles. 
The tilt switches are used to d^ect \diediBr the device is levelled wife fbe floor or 
tilted. 

20 

The system also indndes a number of switdies for input commands from a control 
panel. For example, this enables the user to torn the vacuum cleaner on and off, and to 
select one of a number of deaning programs. 

25 Signals representative of the Doagnetic fields that are sensed by the Han sensors are fed 

to fee processor via the A/D-converter and processed feereby to allow detection of the 
automatic diarging station and the magnetic fence. The offeet voltages of fee analc^ 
Han sensors may vary wife time, t£aiq>exatQie and hidividual semxc&, and feerefoie a 
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zero field reference point is constantly recalculated and adjusted with a slow averaging 
filter based on pulse width modulated signals from die processor. 

In order to detect xnalfimctions, various signals are contumously measured and fed to 
5 the processor for evaluation, either directly via the AfD<ow/eTtsr or first Orougb the 
multiplexer MUX and then via the A/D-converter. 

Cost-based navigation according to the invention 

The invention is preferably, altiiough not necessarily, implonented as software in the 
10 form of computer program modules, fimctions or equivalent stored in appropriate 
memories. The software may be written in any type of conq)uter language, such as C, 
C++, Java or even specialized proprietary hmguages. In practice, the steps, functions 
and actions to be described are mapped into a conqputer program, wbidi when being 
executed by the processor performs die cost4iased navigation of the autonomous 
IS vacuum cleaner. 

The autonomous vacuum deaner basically operates in the followmg manner, hi order 
to traverse a given area to be cleaned, the wheels of the vacuum-cleaner are drivai by 
the wheel motors under the control of the processor, ^Me the fan and brush motors 

20 are qperated to perform die cleaning task. The movement of the vacuum cleaner is 
generally determined by control software executed by the proc^sor in response to 
calculated position information and information on d^ection of obstacles from the 
sonar system. Preferably, the vacuum-deaner starts by making a wall-tracking round, 
allowing the processor to produce a graeral map of the cleaning area as the walls or 

25 similar limitations are ducted during the trading round. 

Accordiog to a basic embodiment of the invention, the control software then divides 
the make area covered by the map or a predetermined part thereof into cells, and 
continuously keeps trade of which cells that are treated, untreated and occupied by 
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obstades as tbe vacuum^leaner is navigated over tbe given field of operation. 
Standing in a given cell, the vacoum-cleaner detennines a navigation route to an 
obstacle-free and untreated cell, and mbves to feat ceU for performing cleaning. 
Once tbe new cell has been cleaned, the cell is indicated as treated, and the cleaner 
normally detennines a new navigation route to another obstacle-free and nntreated 
cell. By defining an energy cost function, it is possible to determine a navigation 
route, to an untreated cell, that requires ft© smallest amount of energy for moving 
the vacuum-cleaner to the cell. 

It has been recognized fliat the CTetgy-conson^on of an autonomous sorfece 
treatment spparalm during treatment of a gben field of qperation is general^ 
dependent an the total distance of ttavd, but also on (he number of required rotations 
of the apparatus. Therefore, a suitable energy cost function is based both on fte 
distance from flje currwit cell to an obstacle-free and untreated cell as well as the 
total dMaige of direction required for movmg thereto and defined so tiiat a larger 
change of direction and a larger distance are given a larger cost 

Cost-based navigation accowlrng to a first embodnnent of the invention will now be 
described in rdation to a particular example by referring to Figs. 5, 6A-D and 7. 

Fig. 5 is a sdbematic drawing of a pxedetemiined field of opetatitm and a 
corresponding cell-based map. As can be seen in the left side drawmg, flie vacuum- 
deaner is located in an mitial position INTT wifli an obstacle (m black) on tiie right 
side and uncleaned areas Qa diagonal lines) above the obstacle and in tiie upper left 
comer, hi tiie map, each cell is being todicated as treated, untreated or occupied by 
au obstade. In this exanq>le, txesOed cells are indicated by flie mteger 200, whfle 
untreated cells are mdicated by the integer 201 . Obstacles of any Idnd are mdicated 
by the integer 255. It is assumed that the obstade has been detected by tiie sonar 
system of the vacuum-cleaner, and that there are two cells, one above the obstacle 
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and one in the iipper left comer of the field of operation, that have not been treated 
by the vacuum-cleaner. 

The task is to find the most cost-effective navigation route to an untreated cell. This 
is preferably accomplished by a structured seardi procedure, which invoNes 
allocation of costs to a number of cells in the surroundings of tiie current cell based 
on distance as well as required diange of direction for moving to the respective ceB. 
For exan^le, if only the four cardinal dkections (forward, 90" to the left, 90" to the 
right and backward) are considered, it may be assumed that the cost to drive forwaid 
1 cell is 1 unit, and the cost to turn 90" is 1 miit The correspondmg energy cost 
function E is defined by accumulating the costs of all forward cell-to-cell movements 
and all 90" rotations required to reach a given cell: 

E = ^C**™""! ^ y^Qiotation 
i j ^ ' 

where C*"*™" is the cost of drivii^ forward 1 ceU and is the cost of tunm^ 
90". Of course, these assunqptions are not compl^fy accurate, but give a radicr 
good estimate of flie total cost to reach a specific location, ^th the above 
assumptions, the search algorithm may be based on the question whether there is so. 
untreated cell witii cost N, where N starts at 1 and is incremented by 1 each 
iteration. 

In this particular inq)lenientation, the procedure starts by building a list of cell(s) 
having cost N around the current cell (step 101 in Fig. 7). When a cell is added to a 
list, the correspondhig cost is preferably stored in a special search map together witii 
a direction mdicator tiiat gives the direction from which flie search algorithm came to 
reach the cell at this cost 
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Mtially. the threshold N is set to 1. Accordingly, the first list contains the 
coordinates for cells with cost 1. This list contains a single cell, since the only 
operation tiiat has the maxinnm cost of 1 is driving forward 1 cell. Fig. 6A shows 
the search map at this stage . The cell with cost 1 is examined with respect to whether 
or not the cell is indicated as untreated (step 102 m Fig . 7) . From the basic map of 
Fig. 5 it can be seen that the cett is indicated as treated. Consequently, N is 
incremented by l(step 103 in Fig. 7) and the procedure contranes by building a list 
with cells of cost 2 (step 101). Fig. fiB shows the search m^ at fliis stage. The cells 
in the list are examined to see whether any cen of cost 2 is mdicaled as mitreated 
(stQ) 102). The basic sean^ map of Fig. 5 indicates flat no cefl m the list of cost 2 
is marked as untreated. This means that N is hicremented once agam (step 103), and 
flat a list with cells of cost 3 is built (st^ 101) . Fig. 6C shows the search map at 

this stagp. Please, note tihat the presence of the obstacle prevents flie allocation of 
cost 3 to the c<m kxated two celb to flie right of the current ceH. The celb in the M 

of cost 3 are flien examined (step 102) . Since no cell in flie list of cost 3 is mdicated 
as untreated m the basic map of Fig. 5, N is incremented once again (stq> 103). This 
time, a list of cells with cost 4 is built (step 101) and examined (step 102). Fig. 6D 
diows the seardi map at dm stage. In fliis case, an untreated ceU is found ^^^^ 

obstacle, and the coiTespandmg lowest-cost route is extracted (step 104 m Fig. 7) by 
using flie direction indicators. 

Urns, the most cost-effective way accordmg to die above energy cost assumptions is 
UP, RIGHT. RIGHT. Using cdls widi a resohition of 30 cm (corresponding to die 
effective size of the vacmniMdeaner), the route can be translated mto drive vectors: 
drive forward 30 m and steq>, make a rigjit 90 • turn and then drive forward 60 cm. 
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The size of the cells can of course be modified, and a resolution of for instance 10 
cm or 20 cm may also be s^ropriate if the effective size of the vacuum cleaner is 30 
cm. 

5 In the following, a more elaborated implementation of the overall search procedure 
will be described with reference to Figs. 8 and 9A-D. 

Jt is assumed that Ifae autunomous vacuumrdeaner is located in the same field of 
opeiatian as described in coimectian with Fig. 5, and therefore Fig. 8 is identical to 
10 Fig. 5. In the same way as before, the task is to find the most cost-effective 
navigation route to an untreated cdU, assomui^ that the cost to drive forward 1 cell is 
1 unit, and the cost to turn 90° is 1 unit The seardi algorithm is based on the 
question whether there is an untreated cell with cost N, where N starts at 1 and 
counts upwards. 

15 

In the currently most preferred inq>lmentation, the search procedure is mitiaiiy/>ri by 
building three lists arouml the current cell. The first list coiitains the cootdmates of 
flie cell wifli cost 1, reached by driving forward 1 step. In die same way, lists with 
cost 2 and cost 3 are built, but limited to cells adjacent die starting cell. Fig. 9A 
20 iUustrates the search map after initialization. 

The lists are processed one by one in cost-order, starting wifli flie list having the 
lowest cost. As a list is bemg processed, die cells are examined one by one to see 
whether any cell is indicated as untreated. However, during die processing of a given 
25 list, new cells are also added to lists of higher costs by considering, for each cell in 
the list under process, die adjacent cells in die directions forward, left and right. 
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For example. st3rttagwffl.thefir8tlfa..tecenw«hc<»tlis e«rfDed with respee. 
to wheter or fte ceU mdicated « -lealed. Ptom Ibe basie n,^ of F«. 8 tf 

CM> be seea ttal tte ceB is talkated as treated. M the «n« time, the 
a^ 3 are updated hy ooiBidetiBg the cells around the eel with COS, 1 . Fro^ 
5 wifl.co«l,itispo«sibletoeo.«i.»«taw««."»tarnto«teside^ 

above fl,eco8t«fdrivi.«&.™rdi.l..iit. while thecostofflrsttandng 90- a=d 

to drivi.* toward is 2 .ntfts. AccamulatiDg the cofls mm t^ 

a« to oen in fl» toward diieetion of the ceD wifli CO* 1 is allocated a total cost «r 

2 a-d added to lie corresponding list. wMle the cells to the left and right of &e ceB 

,0 ^costlaredloc.tedd»tot.lcostof3and.ddedtod«listofcost3.These«ch 

nuip after processing fl» Hst wit CCS. I is inostrated in FSg. 9B. Once, d» list of 

.ost 1 has been processed and fl» of costs 2 and 3 have teea updated, the hst of 

cost 1 is discarded and the piocediire cooftmes wifli the nea Bst. 

« toa,esamew.*asbetoe,fl»eellswidtod»listofcost2a.eexandnedonebyone 
.o see wl«aer any cdl is indicated as nntreaed. AS can be seen from the basic n^ 
rfP« g ancell.otcoa2areindicateda.trealed.Duringfl»processingofaiehst 
ofcost 2, cdls are also added «. the Hst of cost 3 and a new lis. wifl.cens of cost 4 
i. cr«ued. The seard. n«* .«« pocesring of to list of cost 2 is ilh^^rated in F^ 



20 9C. 



25 



The procednre then continue, wia fl» list of cost 3. processhig dB cells one by one. 

Wid. .efbn»« to basic BB? <rf Kg. 8. ^ °' ^ 

indicated as ttealrf. Once the list of a«t 4 has been updated and fl» new list of cost 

5 has been created. tt« list of cost 3 is fflscarded and «» ptocduB. co.^ wid. 
ne« list of cost 4. When to cdl of cost 4 *o»e fl» is exandned, «i 

untteated cdl is tomd and a« scan* is con.pleted (Kg. 9D). Fh»Itr. » 
«ai,cted as a lowest-cost nwB to anunttealed and obstade-ftee cell. 
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Although it has been assumed above that the cost to drive forward 1 cell is 1 unit, 
and die cost to turn 90*^ is 1 unit, it is apparent that diese assumptions can be 
modified in various ways. For example, the relationship between the cost of driving 
forward 1 cell and the cost of turning 90*" can be changed. It is also possible to 
assign costs for turning in various other directions as well. It should also be 
understood that the costs do not have to be in integer values, and diat any real vahies 
can be assigned to represent the costs of driving forward and tummg in different 
directions. 

It is aiqparent that die cost-based navigation of die invention can be used for cleaning 
entire rooms or similar areas in an eni»:gy-e£Bcient way. However, it should be 
understood that die invention is also suitable for so-called "spot cleaning", performing 
effective cleanmg of a smaller area within a room. It is also possible to combine the 
lowest-cost navigation of die invention with any of the prior art techniques, for 
exanq>le by starting with a prior art pattem of movement and continuing wifli the 
lowest-cost navigation of die invention for areas and spots that have been left over. 

For a better understandu^ of die invention, an illustrative exanqile of how die 
autoiKxmous vacuum cleaner navigates to perform spot cleaning of a given cleaning 
area will now be described widi reference to Figs. lOandllA-P. 

Fig. 10 is a scbematicdrawmgofa given cleaning area. The vacuum cleaner is located 
in the middle of the area, widi an obstacle (black) some distance straight ahead. 
Mtialty, the co6re area is uncleaned (diagonal lines). 

The control software produces and continuously iqxlates a cell-based map of die area 
to be cleaned, as can be seen on die rig^ hand side of Figs. UA-P. Each of die cells 
is indicated as cleaned, uncleaned or occupied by an obstacle. Qeaned cells are 
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usually indicated by 200. while uncleaned cells are indicated by 201 and ceUs 
occupied by obstacles of any kind are indicated by 255. In flie Mowing however, 
cleaned cells wiU simply be mdicated by the trace of movement of the vacuum 
cleaner. The control software also produces a number of search maps, as iUustrated 
5 on Hbs left-hand side of Figs. 1 1 A-P. 

As can be seen in Fig. IIA, ±e vacuum cleaner is initially located in the middle of 
the cell-based map, surrounded by undeaned cells. It is possibte to drive forward 1 
step to find an uncleaned cell at cost 1, and tie cleaner therefore drives forward 1 

10 stqp. Prom the new position, it is not possible to contuiue to drive forward due to the 
obstacle, as can be seen in F5g. UB. Therefore, the cleaner has to tum to the left or 
the right to reach the next uncleaned ceU (at cost 2). Inlfais example, the defeult 
choice win always be a left tum if tt is posable totnm both toflie left andtothe 
right. Therefore, the cleaner turns to the left and drives fijrwaid 1 st^ (Fig. HQ. 

15 The vacuum cleaner then continues to drive forward (Fig. 1 ID), and turns to the left 
(Fig. HE) when it reaches the left Ihnitation of the predetermined cleaning area. The 
cleaner now continues to drive along the outer Ihnitation (Rg. IIF-G) until it 
reaches the lower lhnitati<m of fljedeanmg area. The vacmnn deaner then turns left 
and follows the lower and right Ihnitations of the cleamng area (not shown) unta it 

20 reaches the upper limitation (Fig. IIH). At this pomt. the only way out is to tum 
180". This gives a cost of 2 units. Drivmg forward 1 step gives an additional cost of 
1 unit, a total of 3 units. However, this ceU has already been cleaned, and so has the 
cell of cost 4. The cdl of cost 5 is hidicated as undeaned and thereto the vacuum 
deaner navigates to that cdl (Fig. HI). Now, the deana: turns to the left (Pig. lU), 

25 avoiding die obstacle to the right and the forward cell that has akeady been deaned. 
From that position, die cleaner finds an undeaned cell in the forwarf dkection and 
consequenfly drives forward 1 step (Fig. UK). Now, die cleaner has to tum once 
agam to reach a new undeaned cell (Pig. IIL). The cleaner continues m die forward 
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direction (Fig. IIM), and then turns to the right (Fig. UN). From this position, the 
cleaner searches for a new uncleaned cell and by investigating the cells of cost 2 in 
the search map, the cleaner finds diat the lowest-<x)st route to tiie next micleaned cell 
is to drive forwards 2 steps (Fig. 110). The remaining cell to be cleaned is finally 
reached by turning to the left and driving forwards 1 step (Fig. IIP). 

Finally, an iUustrative exanq)le of how die autonomous vacuum cleaner may navigate 
to p^nn cleanipg of an entire room wiO now be outlined with reference to Fig. 12. 
In ibis particular example the room has two elongated obstacles, for example two 
bookshelves. It is furfhennore assumed that the vacuumrcleaner is initially located at 
the dbarging station, and tiien starts by making a wall-tiaddng round, with (or wiOiout) 
die £m and brush motors qperating. Once the vacuumrdeaner returns to the diarging 
station, the cleaner knows that the wall-tracking round has been ccHnpleted. Now, the 
vacuum cleaner omtinues by using the lowest-cost navigation accordmg to flie 
invention and traverses the remaining uncleaned areas of die room excqpt for the 
obstacles. 

The embodiments described above are merely given as examples, and it shcniM be 
understood diat the present invootion is not limited dioeto. Further modifications, 
changes and hnprovements which retain die basic undertying priiKdples disclosed and 
claimed herem are within die scope and sphdit of the invention. 
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A meftod of navigating an a«Umon»m a«6cc .reaUneat appa»Ws om a 

Bredetemined field of operation, comprising Uie stqB of: 

. dividingsaidp«detenmnedfield«fope«tionin«.cdls,ea«hof«lnch 

adapted to be indicated as treated, tmt«aled or occupied by an obstacle; 

- det«mining,fcracumntceUinwhiAthcautonomousapparatas.slocated, 

a navigation «>»te to an obst.cle.fiee «Kl «n 

smallest amom* of ««rgy ft. moving the autonomom snrftce treatment 

appartusfteretoa^ordingtoapreddaminedenergycostflmctiomand 

- „«vigatingtheantonomoussur&ce,reatm»twar.tusftom4ec«n»>.tceB 
^theobstacle-fieeandrntreatedceUaccordingtotheddennin^i^m^^^ 
rerte and HHtoting the indication ottol ceU as treated, 

characleriMd by the stq» of. 

. defining a search algorithm b.«d onthe<p>estion«he«ierthe,e.san 
™«atedccllwithcostH«hereKs.«.satl».dco»ntsnpwardstoc«ate 
a number of cost levels based on specific movements of the antonomoos 
^^tteatmentapparatusrequiredforitto arrive at saidnntre-^dcett; 

- bmlding three lists aromid u,e currrent cell each list containing the 
ooortinatesofcellavriflithelowestcostandofthecoordinattsofcellsofthe 
Woconsec«tiveUgh..eostleveKWU»*«ltocelIsadjaccnt*,thecurrent 

" . ^ing,helis.s.onebyoneincost.<«der,s.arting«ith.helisth»*«the 

lowest cost, wherein asalistisproccssed the cells are examined one by one 

to identic cells indicated as mitreated; 
_ d«ringprocessingofalist.«Jdingcenstothetwoconsecativelistsofh.gher 

cost by cor^dering. ibr each cen nnder process, adjacent celb m the 

directions forward, left and light; 
. aBerprocessingofalistandnpdatmgthetwoconseentivelistsofhighercost, 

aiacardinglhe list nnder process and processingtelist next to Mow; 
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- repeating the search process until an untreated and unoccupied cell has been 
found; 

2. The method according to claim 1 , 

characterized in that said energy cost function depends both on the distance from the 
5 current cell to an obstacle-free and untreated cell as well as the total change of 
direction required for moving thereto, a larger change of direction and a larger distance 
being given a larger cost. 

3. The method according to claim 1 or 2, 

characterized by restricting said autonomous apparatus to move from cell to cell in 
10 a limited number of directions. 

4. The metiiod accordmg to claim 3, 

characterized in that the cost for a route that requires more than one cell-to-cell 
movement is determined by accumulating the cost for each change of direction along 
the route and taking the total distance into account 
15 5. The method according to any of the preceding claims^ 

characterized in that the step of determining a navigation route that requires the 
smallest amount of energy according to apredetermined energy cost function includes 
the steps of: 

- allocating to each ofanumbaofcells in the surroundings ofthe current cell 
20 a cost based on the distance to that cell as well as the total change of direction 

required for moving thereto; 

- checking, in cost-order starting from the cell having the lowest cost, whether 
any of the cost-allocated cells is indicated as untreated until an untreated cell 
is found; and 

25 - . extracting the route to tiie found cell as a lowest-cost route that is used as tiie 
navigation route. 
6. The method according to claim 5, 

characterized by allocating costs to cells in the surroundings of the current cell that 
fall within a given cost interval and checking the cost-allocated cells for an untreated 
30 cell in cost-order, and if no such untreated cell is found among these cells, gradually 
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increasing the cost interval within which cells are allocated costs and continuing to 
check cells in cost-order untU an untreated ceU is found. 

7 The metiliod according to claim 5 or 6, 

characterized by assigning to each cost-allocated ceU a direction in^^^ 
5 extraction ofthe lowest-cost route by means of back tracing. 

8 The method accordmg to any of the preceding clahns, 
characterized inthatthesizeofthecellsis^ximatelyequalto or smaUerthanthe 

size ofthe autonomous apparatus. 

9 The method according to any ofthe preceding claims, 

10 characterizedinthatsdddetetminingstepandsaidnavigatingstq,arerepe^ 

the entire field of operation has been treated. 

10 The method according to any of the preceding claims, 
characterized in that cells are bemg indicated as occupied by an obstacle based on 
infomiation from an obstacle detection system ofthe autonomous apparatus. 

,5 11 Anautonomoussurfecetreatmentapparatushavingpoweroporatedmeansfor 

moving the ^pamtus, a sensing system for detection of obstacles and a navig^on 
system for navigating the apparatus over a predetemnned field of operation, 

said navigation system comprising: 

- meansforlogicallydividingsaidpredetemmiedfieldofoperationintocells, 

20 each of which is bdng ad^ted to be indicated as treated, untreated or 

occupied by an obstacle; 

- meansfordetennining,foracurrentcellinwhiditheautonomousapparatus 

is located, a navigation route to an obstacle-ftee and untreated ceU that 
requires the smallest amount of energy for moving the autonomous surface 
25 treatment ^aratus fliereto according to a predetermined energy cost 

function; and 

- meansfornavigatingtheautonomoussurfecetreatment^aratusfiromtiie 
currentceUtotheobstacl^freeanduntreatedceUaccordmgtothedetermined 

navigation route and updating the indication of that cell as treated, 
30 characterizedbycon^utingmeansad^tedtoperfomithefoUowingoperations: 
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- defining a search algorithm based on the question whether there is an 
untreated cell with cost N, where N starts at 1 and counts upwards, to create 
a number of cost levels based on specific movements of the autonomous 
surface treatment q)paratus required for it to arrive at said untreated cell; 

s - building three lists around the current cell each list containing the coordinates 
of cells with the lowest cost and of the coordinates of cells of Ae two 
consecutive higher cost levels, but limited to cells adjacent to the current cell; 

- processing the lists, one by one in cost-order, starting with the list having the 
lowest cost, wherein as a list is processed the cells are examined one by one 

10 to identify cells indicated as untreated; 

- during processing of a list, adding cells to the two consecutive lists of higher 
cost by considering, for each cell under process, adjacent cells in the 
directions forward, left and right; 

- after processing of a list and updating the two consecutive lists of higher cost, 
15 discarding the list under process until an untreated and unocccupied cell has 

been found. 

1 2. The apparatus according to claim 1 1 , 

characterized in that said energy cost function depends both on the distance from the 
current cell to an obstacle-free and untreated cell as well as the total change of 
20 directionrequiredformovingthereto, alargerchangeof directionandalargerdistance 
being given a larger cost. 

13. The apparatus according to claim 1 1 or 12, 

characterized in that said autonomous apparatus is restricted to move from cell to cell 

in a limited number of directions. 
25 14. The apparatus according to claim 13, 

characterized in that the cost for a route that requires more than one cell-to-cell 

movement is detemiined by accumulating the cost for each change of direction along 

the route and taking the total distance into account. 

15. The apparatus according to any of the claims 1 1-14, 
30 characterized in that said means for determining a navigation route that requires the 
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s„«a,«.»mou„tof»«gy.occrfmg«.ap«de«™nede„ergyco«fcnc«^ 

. „^foraU««ingto«chofa„»mb«ofceUsi«ftes>™undmgsofttie 
o„^„U«oo«bas«lonaiedi8.ancetotha.ceU<»weUa.4>e«,Motage 

of direction requited for moving thereto; 
3 . „,e,„stotohecking,inoost-order«tingfton..h.oeUh.vingthelow«. 

COS.. whcdier any of tlte cost-aUooated cells is indicted untreated nntU 

sudi an untreated cell is found; and 
. ^eamforextractingtteroutetothefoundoeUasalowest^navigaUon 

route to an untreated cell. 
10 16 The apparatus accordingto claim 15, 

etar.c..rix«linfl.atsaidanocatingmeansandsaidd.eckingn»ansin.er«o^^ 
anunmerlWcos.s.redl«ca.edtoceUsin.hesurro«nding,oftheeurren,cell.h.tM 

^.gW.ncostin.«v.l«.d.hat.l«secost.anocatedo.llsarccheclcedincost^^ 

.„findan».«eatedcell.«.d.h.tifnosuch»n,rea.edcettisfoundamong.h^^ 

, fl,ecostin.erval«ithiu«hiehcells«.U«ca.edcos.sisgt«-yincre^ 
checking of cells is continued in cost^untilanuntreat^ledlfafound. 

17 The apparatus according to claim 15 or 16, 

chi^rix^linthataaidnavigation system either comprises means for a« 
^.e^^cost-dlocatedcettadirectionindicatortoenableextracticaofthelo.^^ 

20 route by means of back tracking. 

18 Theapparatusaccordingtoanyoftheclaimsll-17, 

cl^racterizedin^atthesizeofthecellsisapproximatelyequalto 

size of the autonomous appmtus. 

19 Hie ^aratus accordingto any of the claims 11-18, 

. c,„„e..Hz«linth.tde.«miningmeansisconfiguredf6rdete— ^ 

^igati^t routes .ceorfi«gU>«hichth.navigationme«» operas »ntathe«..ne 

field of operation has been treated. 
20. -Hie apparatus according to any of the clahns 11-19, 



30 



20 The apparatus accoromg TO duy wi"*^-*^ — 

ehamcri^d in that said autonomous surface treannent appar^us is operable fi. 
p,rfonning£loort,«*nents«cha3vacuumcleaning.s«ecp>ng.h™Aingorpohs^ 



wo 02/075470 PCT/SE02/00471 

26 

within said field of operation. 

21. A computer program for navigating an autonomous surface treatment 
apparatus over 

a predetermined field of operation, when the program is executed by a computer 
arranged in connection with said autonomous apparatus, 
said computer program comprising: 

- program means for logically dividing said predetermined field of operation 
into cells, each of which adapted to be indicated as treated, untreated or 
occupied by an obstacle; 

- program means for perfomiing, for a current cell in which the autonomous 
apparatus is located, a structured search for an obstacle-firee and untreated 
cell, wherein said program means for performing a structured search 
comprises: 

- program means for allocating to each of a number of cells in the 
surroundings of the current cell a cost based on tiie distance to that cell as 
well as the total change of direction required for moving thereto; 

- program means for checking, in cost-order starting firom the cell having the 
lowest cost, whether any of the cost-allocated cells is indicated as 
untreated until such an untreated cell is found; and 

- program means for extracting the route to a found cell as a lowest-cost 
navigation route to an untreated cell; and 

- program means foi navigating the autonomous surfece treatment apparatus 
firom the current cell to an obstacle-firee and imtreated cell according to the 
extracted lowest-cost navigation route and updating the indication of that 
cell as treated, 

characterized in that said program means for performing a stractured search fiirther 
comprises: 

- program means for building three lists around the current cell, a first list 
containing the coordinates of cells wiA the lowest cost and the two 
additional lists containing tiie coordinates for cells of the two following 
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cost levels, respectively; 

program means for processing the lists, one by one in cost-order, starting 
with Ihe list having the lowest cost, wherein as a list is processed the cells 
are examined one by oneto identify ceUs indicated as untreated; 
5 - saidprogrammeansforprocessingthelistsindoingsoaddingcellstoihe 

two consecutive lists of higher cost by considering, for each cell under 
process, adjacent cells in the direction forward, left and right; 
saidprogrammeans for processing the lists, after completion of a Ust and 
updating the two consecutive lists of higher cost, discarding the list thus 
10 completed and processing the list next to foUow; 

22. The computer program according to claim 21 , 

characterized inthatsaidallocatingprogrammeansandsaidcheckingprogrammeans 
interwork in such a manner that costs are allocated to cells in the surtomidmgs of the 
current cell that feU within a given cost mterval and that these cost-aUocated cells are 
15 chedced in cost-order to find an untreated ceU and that if no such mitreated ceU is 
fomid among Aese cells the cost interval within whidi cells are allocated costs is 
gradually increased and the checking of cells is continued in cost-order mitil an 
untreated cell is found. 

23. The computer program according to claim 21 or 22, 
20 characterized by piogrammeans for assigoingto each cost-allocated cell a direction 
indicator to enable extraction of the lowest-cost route by means of back tracing. 
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Fig. 2 



wo 02/075470 



2/13 



PCT/SE02/00471 




wo 02/075470 



PCT/SE02/00471 



3/13 



CLK 



\L-BUMPER ^ 



TILT 
^SWITCHES, 



INPUT 
COMMANDS. 



L-HALL 
SENSOR 



R-HALL 
SENSOR 



FPROM 

512X8 



RAM 
512X16 



eVrom 

256x16 



CPU 



MC68332 



I: 



I: 



TRANSMITTER 



PWM 



L-WHEEL 
MOTOR 
DRIVER 



QENC 



L-WHEEL 
MOTOR 



R-WHEEL 
MOTOR 
DRIVER 



R-WHEEL 
MOTOR 

ZIZ 

QENC 



DIR. 



BRUSH 
MOTOR 
DRIVER 



BRUSH 
MOTOR 



PWM 



FAN 
MOTOR 
DRIVER 



FAN 
MOTOR 



A/D 



RECEIVER 



AID 
INPUT 



MUX 



MUX 
INPUT 



Fig. 4 



PCT/SE02/00471 



WO 02/075470 



4/13 



o 
o 


o 
o 

CM 


O 
CM 


in 
m 

CM 


in 
in 

CM 


o 
o 

CM 


O 
O 
CM 


O 
O 

|CM 


o 
o 

CM 


o 


O 
O 
CM 


O 
O 
CM 


"O 
O 
CM 




o 
o 

CM 


O 
O 
CM 


O 
O 
CM 


O 
O 
CM 


o 
o 

CM 


O 
O 
CM 


O 
CM 


O 
O 
CM 


O 
O 
CM 


O 
O 
CM 


O 
O 
CM 




lO 






( 

L 

\ 








Q 

CD 

d) 
b. 

CO 

• 

u. 




A 


CO 


CM ► 

A 




CO^ 


CM^ 




o ► 


•CO 




T 


▼ 

CO 


T 

CM > 








T 


T 

CO 
























CO 
A 


CM 

A 






CM^ 




o 


► CO. 






▼ 

CO 


T 

M 










T 

CO 


1 






























C4 
A 




UJ 




CM 




A o 




(O 
• 








▼ 

CM 




u. 















d> 



wo 02/075470 



PCT/SE02/00471 



5/13 



STARTING IN 
A CURRENT CELL 



BUILD LIST OF CELL(S) 
WITH COST N 
(N INITIATED AS EQUAL TO 1) 



101 



INCREMENT N 
(BY1) 




104- 



EXTRACT ROUTE TO 
THE UNTREATED CELL 



Fig. 7 



wo 02/075470 



PCT/SE02/00471 



6/13 



o 
o 

CM 


O 
O 
CM 


o 

CM 


iO 
LO 
CM 


LO 

m 

CM 


O 
O 
CM 


O 
O 
CM 


O 
O 
CM 


O 
O 
CM 


o 
o 

CM 


O 
O 
CM 


O 
O 
CM 


O 
O 
CM 


^1 


o 
o 

CM 


O 
O 
CM 


O 
O 
CM 


O 
O 
CM 


O 
O 
CM 


O 
CM 


o 

CM 


O 
O 
CM 


O 

(8 


O 
O 
CM 


o 
o 

CM 




00 













Fig. 9C Fig. 9D 


liv 
A 


▲ 


CO 
A 


CM ► 

A 




co-^ 






o ► 


CO 


lO 


▼ 


T 

CO 


T 

CM ► 








▼ 


T 

CO » 





















, A 


CO 
A 


CM 
A 




co^ 


CM^ 




o 


► CO 




T 


T 

CO 


▼ 

CM 










▼ 

CO 





























CO 
A 


CM 

A 








CM 




A o 


► CO 


o> 






▼ 

CO 


T 

CM 




u. 































CM 
▲ 










O 


► CO 








T 

CM 















< 

d> 
il 



WO02/075470 



PCT/SE02/00471 



7/13 




Fig. 10 
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Fig. 11 A 















2 


0 


2 



































201 


201 


255 


255 


201 


201 


201 


4- 


201 


201 


201 


201 




201 


201 


201 


201 


201 


201 


201 


201 


201 


201 


201 


201 



Fig. 1 1B 
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Fig.11C 
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Fig.11D 
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Fig. 11 H 
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Fig. 111 
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